research-article

Analyzing Organizational Routines in Online Knowledge Collaborations: A Case for Sequence Analysis in CSCW

Authors:

Brian C. Keegan,

Ofer ArazyAuthors Info & Claims

CSCW '16: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing

Pages 1065 - 1079

https://doi.org/10.1145/2818048.2819962

Published: 27 February 2016 Publication History

Abstract

Research into socio-technical systems like Wikipedia has overlooked important structural patterns in the coordination of distributed work. This paper argues for a conceptual reorientation towards sequences as a fundamental unit of analysis for understanding work routines in online knowledge collaboration. We outline a research agenda for researchers in computer-supported cooperative work (CSCW) to understand the relationships, patterns, antecedents, and consequences of sequential behavior using methods already developed in fields like bio-informatics. Using a data set of 37,515 revisions from 16,616 unique editors to 96 Wikipedia articles as a case study, we analyze the prevalence and significance of different sequences of editing patterns. We illustrate the mixed method potential of sequence approaches by interpreting the frequent patterns as general classes of behavioral motifs. We conclude by discussing the methodological opportunities for using sequence analysis for expanding existing approaches to analyzing and theorizing about co-production routines in online knowledge collaboration.

References

[1]

Andrew Abbott. 1990. A primer on sequence methods. Organization Science 1, 4 (1990), 375–392.

Digital Library

[2]

Andrew Abbott. 1995. Sequence analysis: new methods for old ideas. Annual Review of sociology (1995), 93–113.

[3]

Ritu Agarwal, Anil K. Gupta, and Robert Kraut. 2008. Editorial Overview–The Interplay Between Digital and Social Networks. Information Systems Research 19, 3 (2008), 243–252.

[4]

Ofer Arazy and Arie Croitoru. 2010. The Sustainability of Corporate Wikis: A Time-series Analysis of Activity Patterns. ACM Trans. Management Information Systems 1, 1 (2010), 6:1–6:24.

Digital Library

[5]

Ofer Arazy and Rick Kopak. 2011. On the measurability of information quality. Journal of the American Society for Information Science and Technology 62, 1 (2011), 89–99.

Digital Library

[6]

Ofer Arazy, Oded Nov, Raymond Patterson, and Lisa Yeo. 2011. Information Quality in Wikipedia: The Effects of Group Composition and Task Conflict. Journal of Management Information Systems 27, 4 (2011), 71–98.

Digital Library

[7]

Ofer Arazy, Felipe Ortega, Oded Nov, Lisa Yeo, and Adam Balila. 2015. Functional Roles and Career Paths in Wikipedia. In Proc. CSCW 2015. ACM, 1092–1105.

Digital Library

[8]

Markus C Becker. 2008. The past, present, and future of organizational routines. In Handbook of Organizational Routines. Edward Elgar Publishing.

[9]

Yoav Benjamini and Yosef Hochberg. 1995. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society. Series B (Methodological) 57, 1 (1995), 289–300.

[10]

Yochai Benkler. 2006. The Wealth of Networks: How Social Production Transforms Markets and Freedom. Yale University Press, New Haven, CT, USA.

Digital Library

[11]

Donald J Berndt and James Clifford. 1994. Using Dynamic Time Warping to Find Patterns in Time Series. In Proc. KDD 1994. AAAI, 359–370.

[12]

Susan L. Bryant, Andrea Forte, and Amy Bruckman. 2005. Becoming Wikipedian: Transformation of Participation in a Collaborative Online Encyclopedia. In Proc. GROUP 2005 (GROUP '05). ACM, 1–10.

Digital Library

[13]

Kevin Crowston, Kangning Wei, James Howison, and Andrea Wiggins. 2008. Free/Libre Open-source Software Development: What We Know and What We Do Not Know. ACM Computing Survey 44, 2 (2008), 7:1–7:35.

Digital Library

[14]

Cleidson De Souza, Jon Froehlich, and Paul Dourish. 2005. Seeking the source: software source code as a social and technical artifact. In Proc. GROUP 2005. 197–206. http://dl.acm.org/citation.cfm?id=1099239

Digital Library

[15]

A. P. Dempster, N. M. Laird, and D. B. Rubin. 1977. Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society. Series B (Methodological) 39, 1 (1977), 1–38.

[16]

Wil Dijkstra and Toon Taris. 1995. Measuring the Agreement between Sequences. Sociological Methods & Research 24, 2 (1995), 214–231.

[17]

Nicolas Ducheneaut. 2005. Socialization in an Open Source Software Community: A Socio-Technical Analysis. Computer Supported Cooperative Work (CSCW) 14, 4 (2005), 323–368.

Digital Library

[18]

Cody Dunne, Nathalie Henry Riche, Bongshin Lee, Ronald Metoyer, and George Robertson. 2012. GraphTrail: analyzing large multivariate, heterogeneous networks while supporting exploration history. In Proc. CHI 2012. ACM, 1663–1672.

Digital Library

[19]

Samer Faraj, Sirkka L Jarvenpaa, and Ann Majchrzak. 2011. Knowledge collaboration in online communities. Organization Science 22, 5 (2011), 1224–1239.

Digital Library

[20]

MS Feldman and BT Pentland. 2003. Reconceptualizing Organizational Routines as a Source of Flexibility and Change. Administrative Science Quarterly 48 (2003), 94–121. 1.

[21]

Martha S. Feldman. 2000. Organizational Routines as a Source of Continuous Change. Organization Science 11, 6 (2000), 611–629.

Digital Library

[22]

Martha S. Feldman and Anat Rafaeli. 2002. Organizational Routines as Sources of Connections and Understandings. Journal of Management Studies 39, 3 (2002), 309–331.

[23]

Danyel Fisher and Paul Dourish. 2004. Social and temporal structures in everyday collaboration. In Proc. CHI 2004. ACM, 551–558.

Digital Library

[24]

Andrea Forte, Vanesa Larco, and Amy Bruckman. 2009. Decentralization in Wikipedia Governance. Journal of Management Information Systems 26, 1 (2009), 49–72.

Digital Library

[25]

James Gaskin, Nicholas Berente, Kalle Lyytinen, and Youngjin Yoo. 2014. Toward Generalizable Sociomaterial Inquiry: A Computational Approach for Zooming in and Out of Sociomaterial Routines. MIS Quarterly 38, 3 (2014), 849–A12.

Digital Library

[26]

R. Stuart Geiger and Aaron Halfaker. 2013. Using edit sessions to measure participation in wikipedia. In Proc. CSCW 2013. ACM, 861–870.

Digital Library

[27]

David R. Gibson. 2005. Taking Turns and Talking Ties: Networks and Conversational Interaction. Amer. J. Sociology 110, 6 (2005), 1561–1597. http://www.jstor.org/stable/10.1086/428689

[28]

Jody Hoffer Gittell and Leigh Weiss. 2004. Coordination Networks Within and Across Organizations: A Multi-level Framework. Journal of Management Studies 41, 1 (2004), 127–153. //dx.doi.org/10.1111/j.1467-6486.2004.00424.x

[29]

Eric Gleave, Howard T Welser, Thomas M Lento, and Marc A Smith. 2009. A conceptual and operational definition of'social role'in online community. In Proc. HICSS 2009. IEEE, 1–11.

Digital Library

[30]

S.P. Goggins, M. Gallagher, J. Laffey, and C. Amelung. 2010. Social Intelligence in Completely Online Groups Toward Social Prosthetics from Log Data Analysis and Transformation. In Proc. SocialCom. IEEE, 500–507.

Digital Library

[31]

Sean Goggins and Eva Petakovic. 2014. Connecting Theory to Social Technology Platforms A Framework for Measuring Influence in Context. American Behavioral Scientist 58, 10 (2014), 1376–1392.

[32]

Jiawei Han, Hong Cheng, Xin Dong, and Xifeng Yan. 2007. Frequent pattern mining: current status and future directions. Data Mining and Knowledge Discovery 15, 1 (2007), 55–86.

Digital Library

[33]

Christine Hine. 2000. Virtual ethnography. Sage.

[34]

James Howison and Kevin Crowston. 2014. Collaboration Through Open Superposition: A Theory of the Open Source Way. MIS Quarterly 38, 1 (2014), 29–A9.

Digital Library

[35]

James Howison and Andrea Wiggins. 2011. Validity Issues in the Use of Social Network Analysis with Digital Trace Data. Journal of the Association for Information Systems 12, 12 (2011), 767–797.

[36]

Isa Jahnke. 2010. Dynamics of social roles in a knowledge management community. Computers in Human Behavior 26, 4 (2010), 533–546.

Digital Library

[37]

David Jurgens and Tsai-Ching Lu. 2012. Temporal Motifs Reveal the Dynamics of Editor Interactions in Wikipedia. In Proc. ICWSM 2012. AAAI, 162–169.

[38]

Gerald C. Kane, Jeremiah Johnson, and Ann Majchrzak. 2014. Emergent Life Cycle: The Tension Between Knowledge Change and Knowledge Retention in Open Online Coproduction Communities. Management Science 60, 12 (2014), 3026–3048.

Digital Library

[39]

Brian Keegan, Darren Gergle, and Noshir Contractor. 2012. Staying in the loop: structure and dynamics of Wikipedia's breaking news collaborations. In Proc. WikiSym 2012. ACM, 1:1–1:10.

Digital Library

[40]

Brian Keegan, Darren Gergle, and Noshir Contractor. 2013. Hot Off the Wiki Structures and Dynamics of Wikipedia's Coverage of Breaking News Events. American Behavioral Scientist 57, 5 (2013), 595–622.

[41]

Aniket Kittur, Bongwon Suh, Bryan A. Pendleton, and Ed H. Chi. 2007. He Says, She Says: Conflict and Coordination in Wikipedia. In Proc. CHI 2007. ACM, New York, NY, USA, 453–462.

Digital Library

[42]

Travis Kriplean, Ivan Beschastnikh, and David W. McDonald. 2008. Articulations of Wikiwork: Uncovering Valued Work in Wikipedia Through Barnstars. In Proc. CSCW 2008. ACM, 47–56.

Digital Library

[43]

John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proc. ICML 2001. Morgan Kaufmann Publishers Inc., 282–289.

Digital Library

[44]

Karim R Lakhani and Eric von Hippel. 2003. How open source software works: 'free' user-to-user assistance. Research Policy 32, 6 (2003), 923–943.

[45]

David Lazer, Alex Sandy Pentland, Lada Adamic, Sinan Aral, Albert Laszlo Barabasi, Devon Brewer, Nicholas Christakis, Noshir Contractor, James Fowler, Myron Gutmann, and others. 2009. Life in the network: the coming age of computational social science. Science 323, 5915 (2009), 721.

[46]

Jessica Lin, Eamonn Keogh, Wei Li, and Stefano Lonardi. 2007. Experiencing SAX: a novel symbolic representation of time series. Data Mining and Knowledge Discovery 15, 2 (2007), 107–144.

Digital Library

[47]

TW Malone and K Crowston. 1994. The interdisciplinary study of coordination. Comput. Surveys 26 (1994), 119. 1.

Digital Library

[48]

Kumiyo Nakakoji, Yasuhiro Yamamoto, Yoshiyuki Nishinaka, Kouichi Kishida, and Yunwen Ye. 2002. Evolution patterns of open-source software systems and communities. In Proceedings of the international workshop on Principles of software evolution. 76–85. http://dl.acm.org/citation.cfm?id=512055

Digital Library

[49]

Richard R Nelson and G Sidney. 2005. Winter. 1982. An evolutionary theory of economic change. Cambridge: Belknap (2005).

[50]

J.F. Olson, J. Howison, and K.M. Carley. 2010. Paying Attention to Each Other in Visible Work Communities: Modeling Bursty Systems of Multiple Activity Streams. In Proc. SocialCom 2010. 276–281.

Digital Library

[51]

Brian T. Pentland. 1995. Grammatical Models of Organizational Processes. Organization Science 6, 5 (1995), 541–556.

Digital Library

[52]

Brian T. Pentland and Martha S. Feldman. 2007. Narrative networks: Patterns of technology and organization. Organization Science 18, 5 (2007), 781–795.

Digital Library

[53]

Brian T. Pentland and Martha S. Feldman. 2008. Designing routines: On the folly of designing artifacts, while hoping for patterns of action. Information and Organization 18, 4 (2008), 235–250. //dx.doi.org/10.1016/j.infoandorg.2008.08.001

Digital Library

[54]

Brian T. Pentland and Henry H. Rueter. 1994. Organizational Routines as Grammars of Action. Administrative Science Quarterly 39, 3 (1994), 484–510.

[55]

Sam Ransbotham and Gerald C. Kane. 2011. Membership Turnover and Collaboration Success in Online Communities: Explaining Rises and Falls from Grace in Wikipedia. MIS Quarterly 35, 3 (2011), 613–627.

Digital Library

[56]

Hugues Salamin and Alessandro Vinciarelli. 2011. Introduction to Sequence Analysis for Human Behavior Understanding. In Computer Analysis of Human Behavior, Albert Ali Salah and Theo Gevers (Eds.). Springer London, 21–40.

[57]

R. K. Shelly. 1997. Sequences and Cycles in Social Interaction. Small Group Research 28, 3 (1997), 333–356.

[58]

Mario Luis Small. 2011. How to Conduct a Mixed Methods Study: Recent Trends in a Rapidly Growing Literature. Annual Review of Sociology 37, 1 (2011), 57–86. //dx.doi.org/10.1146/annurev.soc.012809.102657

[59]

Marc A. Smith and Andrew T. Fiore. 2001. Visualization components for persistent conversations. In Proc. CHI 2001. ACM, 136–143.

Digital Library

[60]

Arun Sundararajan, Foster Provost, Gal Oestreicher-Singer, and Sinan Aral. 2013. Information in Digital, Economic, and Social Networks. Information Systems Research 24, 4 (2013), 883–905.

Digital Library

[61]

Jason Tsay, Laura Dabbish, and James Herbsleb. 2014. Influence of Social and Technical Factors for Evaluating Contribution in GitHub. In Proc. ICSE 2014. ACM, 356–366.

Digital Library

[62]

Michael L. Tushman and David A. Nadler. 1978. Information Processing as an Integrating Concept in Organizational Design. The Academy of Management Review 3, 3 (1978), 613–624.

[63]

Wil MP van der Aalst, Hajo A Reijers, and Minseok Song. 2005. Discovering social networks from event logs. Computer Supported Cooperative Work 14, 6 (2005), 549–593.

Digital Library

[64]

Wil MP van der Aalst, Boudewijn F van Dongen, Joachim Herbst, Laura Maruster, Guido Schimm, and AJMM Weijters. 2003. Workflow Mining: a survey of issues and approaches. Data & Knowledge engineering 47, 2 (2003), 237–267.

Digital Library

[65]

Fernanda B. Viégas, Martin Wattenberg, and Kushal Dave. 2004. Studying Cooperation and Conflict Between Authors with History Flow Visualizations. In Proc. CHI 2004. ACM, 575–582.

Digital Library

[66]

Zhengzheng Xing, Jian Pei, and Eamonn Keogh. 2010. A Brief Survey on Sequence Classfication. SIGKDD Explorations Newsletter 12, 1 (2010), 40–48.

Digital Library

[67]

Yutaka Yamauchi, Makoto Yokozawa, Takeshi Shinohara, and Toru Ishida. 2000. Collaboration with Lean Media: How Open-source Software Succeeds. In Proc. CSCW 2000. ACM, 329–338.

Digital Library

[68]

Taha Yasseri, Robert Sumi, András Rung, András Kornai, and János Kertész. 2012. Dynamics of Conflicts in Wikipedia. PLoS ONE 7, 6 (2012), e38869.

[69]

Yongjin Yoo. 2012. Digital Materiality and the Emergence of an Evolutionary Science of the Artficial. In Materiality and Organizing: Social Interaction in a Technological World, Paul M. Leonardi, Bonnie A. Nardi, and Jannis Kallinikos (Eds.). Oxford University Press.

Cited By

Moore RDahlke RForberg PHancock J(2024)The Private Life of QAnon: A Mixed Methods Investigation of Americans' Exposure to QAnon Content on the WebProceedings of the ACM on Human-Computer Interaction10.1145/36870578:CSCW2(1-34)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687057
Flöck FUlloa RAcosta M(2024)Chapter 7. Live exploration of Wikipedia editing dynamics with visual analyticsInvestigating Wikipedia10.1075/scl.121.07flo(178-204)Online publication date: 25-Oct-2024
https://doi.org/10.1075/scl.121.07flo
Polychronis CKogan M(2023)Working Together (to Undermine Democratic Institutions): Challenging the Social Bot Paradigm in SSIO ResearchProceedings of the ACM on Human-Computer Interaction10.1145/36100337:CSCW2(1-30)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610033
Show More Cited By

Analyzing Organizational Routines in Online Knowledge Collaborations: A Case for Sequence Analysis in CSCW
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
2. Social and professional topics
  1. Professional topics
    1. Computing and business

Recommendations

Toward generalizable sociomaterial inquiry: a computational approach for zooming in and out of sociomaterial routines

In this paper, a computational, mixed methods approach that combines qualitative analysis with a novel approach to sequence analysis for studying the entanglement of human activities and digital capabilities in organizational routines is described. The ...
Evolving Work Routines: Adaptive Routinization of Information Technology in Healthcare

Despite the significant potential for performance gains from health IT (HIT), there has been limited study of the mechanisms underlying successful HIT implementations. We conducted an extensive longitudinal field study to gain an understanding of the ...
Rethinking Stability and Change in the Study of Organizational Routines: Difference and Repetition in a Newspaper-Printing Factory
Special Issue on Routine Dynamics

Organizational life consists of an ever-changing world of encounters, experiences, and complex sociomaterial relations. Within this context, standard routines can be seen as a solution to problems of inefficiency within organizations, especially when ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '16: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing

February 2016

1866 pages

ISBN:9781450335928

DOI:10.1145/2818048

General Chairs:
Darren Gergle
Northwestern University
,
Meredith Ringel Morris
Microsoft Research
,
Program Chairs:
Pernille Bjørn
University of Copenhagen
,
Joseph Konstan
University of Minnesota

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 February 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Social Sciences and Humanities Research Council of Canada

Conference

CSCW '16

Sponsor:

SIGCHI

CSCW '16: Computer Supported Cooperative Work and Social Computing

February 27 - March 2, 2016

California, San Francisco, USA

Acceptance Rates

CSCW '16 Paper Acceptance Rate 142 of 571 submissions, 25%;

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
267
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Moore RDahlke RForberg PHancock J(2024)The Private Life of QAnon: A Mixed Methods Investigation of Americans' Exposure to QAnon Content on the WebProceedings of the ACM on Human-Computer Interaction10.1145/36870578:CSCW2(1-34)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687057
Flöck FUlloa RAcosta M(2024)Chapter 7. Live exploration of Wikipedia editing dynamics with visual analyticsInvestigating Wikipedia10.1075/scl.121.07flo(178-204)Online publication date: 25-Oct-2024
https://doi.org/10.1075/scl.121.07flo
Polychronis CKogan M(2023)Working Together (to Undermine Democratic Institutions): Challenging the Social Bot Paradigm in SSIO ResearchProceedings of the ACM on Human-Computer Interaction10.1145/36100337:CSCW2(1-30)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610033
Das PGuda BSeelaboyina SSarkar SMukherjee A(2022)Quality Change: Norm or Exception? Measurement, Analysis and Detection of Quality Change in WikipediaProceedings of the ACM on Human-Computer Interaction10.1145/35129596:CSCW1(1-36)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512959
Mahringer C(2022)Analyzing Digital Trace Data to Promote Discovery – The Case of HeatmappingBusiness Process Management Workshops10.1007/978-3-030-94343-1_16(209-220)Online publication date: 23-Jan-2022
https://doi.org/10.1007/978-3-030-94343-1_16
Mahringer CPentland B(2021)Sequence Analysis in Routine DynamicsCambridge Handbook of Routine Dynamics10.1017/9781108993340.015(172-183)Online publication date: 11-Dec-2021
https://doi.org/10.1017/9781108993340.015
(2021)Methodological Issues in Routine Dynamics ResearchCambridge Handbook of Routine Dynamics10.1017/9781108993340.010(101-206)Online publication date: 11-Dec-2021
https://doi.org/10.1017/9781108993340.010
Van Swol LKolb MAsan O(2020)‘We are on the same page:' the importance of doctors EHR screen sharing for promoting shared information and collaborative decision-makingJournal of Communication in Healthcare10.1080/17538068.2020.177751213:2(129-137)Online publication date: 22-Jun-2020
https://doi.org/10.1080/17538068.2020.1777512
Das Swain VReddy MNies KTay LDe Choudhury MAbowd G(2019)Birds of a Feather Clock TogetherProceedings of the ACM on Human-Computer Interaction10.1145/33592673:CSCW(1-30)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359267
Dias AFranca JVivacqua ABorges MLima B(2019)eMOC: An Observation Tool for Collaborative Analysis in Teamwork2019 IEEE 23rd International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD.2019.8791498(45-50)Online publication date: May-2019
https://doi.org/10.1109/CSCWD.2019.8791498
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten